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Abstract. To certain types of generic distributions (subbundles 
in a tangent bundle) one can associate canonical Cartan connec- 
tions. Many of these constructions fall into the class of parabolic 

C | geometries. The aim of this article is to show how strong restric- 

tions on the possibles sizes of automorphism groups of such dis- 
tributions can be deduced from the existence of canonical Cartan 
connections. This needs no information on how the Cartan connec- 
tions are actually constructed and only very basic information on 

SZ their properties. In particular, we discuss the examples of generic 

distributions of rank two in dimension five, rank three in dimension 
six, and rank four in dimension seven. 
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1. Introduction 



> 

q ■ This article deals with geometric questions on subbundles in the tan- 

r^| ! gent bundles of smooth manifolds. While such structures always have 

been of interest in control theory, their importance in various parts of 



differential geometry and geometric analysis has increased a lot during 
the last years. This refers to, for example, sub-Riemannian structures, 
questions related to Carnot groups and Carnot-Caratheodory mani- 
folds, as well as analytical properties of differential operators obtained 
as sums of squares of sections of such subbundles. 

Since integrable subbundles can be removed by passing to leaves 
of the corresponding foliation, one usually restricts the attention to 
bracket generating distributions. This condition means that sections of 
the distribution together with their iterated Lie brackets span the full 
tangent bundle. 
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Even under this assumption, different types of distributions can have 
entirely different behavior. For example, consider automorphisms of a 
distribution, i.e. diffeomorphisms of the manifold whose derivatives in 
all points respect the distribution. On the one hand, there are examples 
like contact distributions, which admit a local normal form and always 
have infinite dimensional families of automorphisms. The first example 
of the other possible behavior was found independently by F. Engel 
and E. Cartan in their work on exceptional Lie algebras of type C?2- 
It was studied in detail in Cartan's famous "five variables paper" [6j. 
In this article, he studied distributions of rank two and three on five 
dimensional manifolds, which, in addition to being bracket generating, 
satisfy a genericity condition. He associated to such distributions a 
canonical Cartan connection on a certain principal bundle. This imme- 
diately implies that such distributions have local invariants (similar to 
the curvature of a Riemannian metric) and hence cannot admit simple 
local normal forms. Further, it implies that the automorphisms of such 
a distribution form a finite dimensional Lie group and each automor- 
phism is determined by some finite jet (actually the two-jet) in one 
point. 

Cartan's result has been (much later) extended to various other 
generic types of distributions. Many of these examples fall into the 
class of so called parabolic geometries, since the homogeneous model of 
the geometry is the quotient of a semisimple Lie group by a parabolic 
subgroup. Motivated by the examples of conformal structures and CR 
structures, these geometries have been intensively studied during the 
last years, and many striking results have been achieved. 

The results on existence of canonical Cartan connections are usu- 
ally difficult and Cartan connections themselves are often considered 
as being hard to use. In this article we want to show that Cartan con- 
nections lead to interesting results on distributions in a rather simple 
way. For these applications, no knowledge about the actual construc- 
tion of the Cartan connections but only some basic information about 
their properties is needed. We show that simple algebraic computations 
(mostly linear algebra) can be used to obtain surprising restrictions on 
the possible dimensions of the automorphism groups of certain types 
of distributions. 

The basic ideas we use certainly go back to Cartan, the more specific 
version for parabolic subalgebras has been implicitly used in [Tj5] in the 
study of automorphism groups of CR structures. They have been ex- 
plicitly formulated in pf] in the context of general parabolic geometries. 
The algebraic computations needed to apply these ideas in the cases of 
generic distributions discussed here as well as some of the realizations 
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of automorphism groups are part of the second author's diploma thesis, 
see 1 131. 



2. Distributions which are equivalent to parabolic 

geometries 

In this section, we give a brief description of the relation between cer- 
tain types of distributions and parabolic geometries, i.e. Cartan connec- 
tions with homogeneous model the quotient of a semisimple Lie group 
by a parabolic subgroup. 

2.1. Parabolic subalgebras. These are a special type of subalgebras 
in semisimple Lie algebras, which can be defined in several equivalent 
ways. In terms of structure theory, one best defines a parabolic sub- 
algebra in a complex semisimple Lie algebra as one which contains a 
maximal solvable subalgebra (which usually is called a Borel subalge- 
bra) . Then one defines parabolic subalgebras in real semisimple Lie al- 
gebras via complexification. Equivalently, one may define a subalgebra 
in an arbitrary semisimple Lie algebra to be parabolic if its nilradical 
coincides with its annihilator under the Killing form, see [3]. 

For our purposes, the most useful definition is the one in terms of \k\- 
gradings, which also handles the real and complex cases simultaneously. 

Definition. Let g be a real or complex semisimple Lie algebra, and 
let A; be a positive integer. 

(1) A |/c|-grading on g is a vector space decomposition g = g_fcffi- • -®Qk 
such that we have [&, Qj] C Qi + j for all % and j, with the convention that 
Qi = {0} for \£\ > k, and such that the subalgebra g_ := g_fcffi- • -©g_i 
is generated by g_i. 

(2) Given a \k (-grading as in (1), we put g l := Qi © • ■ ■ © g^ for all i as 
well as p := g° and p + := g 1 . 

(3) A Lie subalgebra p of g is called parabolic if it can be realized as g° 
for some | k | -grading of g. 

The subspaces g* from (2) define a decreasing filtration of g, which 
makes g into a filtered Lie algebra, i.e. [fl 1 ^] C g* +J for all i,j. In 
particular, this implies that p = g° is a Lie subalgebra of g, and that 
p + = g 1 is an ideal in p, which is nilpotent since the grading has finite 
length. Likewise, g_ C g is a nilpotent Lie subalgebra. It turns out, see 
[2"U] . that the Lie algebras g_ and p + are always isomorphic. From the 
filtration property it also follows that each of the filtration components 
g* is p-invariant. 

By the grading property, g C p C g is a Lie subalgebra, and each 
of the grading components g» is g -invariant. It turns out that the Lie 
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algebra g is always reductive, so it is the direct sum of a semisimple 
Lie algebra and a center. In particular, the representation theory of Qq 
is significantly easier than the one of the parabolic p, which makes go a 
valuable technical tool in the theory. Moreover, it turns out that com- 
pletely reducible representations of p always come from representation 
of go via the quotient map p — > p/p+ = 0o- 

A crucial feature of the theory is the computability of the Lie algebra 
cohomology groups H*(q_, q) via Kostant's version of the Bott-Borel- 
Weil theorem, see [8]. The standard complex for computing these coho- 
mologies consists of spaces of multilinear alternating maps from g_ to 
0. In particular, g acts naturally on these spaces and it is easy to see 
that the differentials in the standard complex are go equivariant . Hence 
the cohomologies naturally are representations of q , and Kostant's re- 
sults describes them as such representations. The computation of the 
cohomologies is completely algorithmic and it is also implemented by 
J. Silhan as an extension to the Lie software system, see [T7], so the 
computation of the cohomologies can be left to a computer. 



2.2. The symbol algebra of a distribution. Let M be a smooth 
manifold and let H C TM be a distribution, i.e. a smooth subbundle. 
We assume that H is bracket generating, i.e. that sections of H to- 
gether with their iterated Lie brackets span the whole tangent bundle. 
We will also write T~ X M for H. Next we require that sections of H 
together with Lie brackets of two such sections span a smooth subbun- 
dle T~ 2 M C TM, which by construction contains T~ X M. Inductively, 
we require that we get a filtration TM = T~ k M D T- k+1 M D • • • D 
T~ X M of the tangent bundle by smooth subbundles, such that for each 
i < sections of T l M together with Lie brackets of one section of T % M 
and one section of T~ X M span T % ~ 1 M. The sequence of the ranks of 
the subbundles T % M is usually called the small growth vector of the 
distribution H. 

Having extended the distribution H to the filtration {T l M}, one 
can next encode the non-integrability properties of H. Namely, for 
each i = -k,...,-l, one defines gr^TM) := T i M/T i+1 M, and then 
gr(TM) = ©grj(TM) is the associated graded to the filtered vector 
bundle TM. One immediately verifies, that for sections £ G Y(T l M) 
and f] G r(T J M), the Lie bracket [£,??] is a section of T l+ ^M, where 
T e M = TM for £ < —k. Hence the Lie bracket of vector fields induces 
a bilinear bundle map gr^ (TM) x gr ATM) — > gr i+ ATM), which for 
each x G M makes gr(T x M) into a nilpotent graded Lie algebra. This 
is called the symbol algebra of the distribution H at x. 
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Suppose that / : M — > M is a diffeomorphism such that Tf(H) C H . 
Then by construction Tf preserves each of the subbundles T % M and 
hence is compatible with the filtration of TM. Hence for each x G 
M, the tangent map T x f induces a linear isomorphism gr(T x M) — > 
gr(Tff x -\M), Compatibility of Tf with the Lie bracket of vector fields 
immediately implies that this map actually is an isomorphism of the 
symbol algebras at x and f{x). Hence the symbol algebra is a funda- 
mental invariant of the distribution. 

In general, the isomorphism type of the symbol algebra may change 
from point to point, but we will be only interested in distributions for 
which gr (TM) is locally trivial as a bundle of nilpotent graded Lie 
algebras. If n = n_^ © • • • © n_i is the modelling nilpotent graded 
Lie algebra, then gr(TM) has an obvious natural frame bundle with 
structure group Aut flr (n), the group of automorphisms of the graded 
Lie algebra n, compare with |llj . 

2.3. From parabolics to distributions. Consider a |fc|~graded Lie 
algebra g = ©f = _ fc 0j as in 12. H and the corresponding filtration {g 1 }. Let 
G be a Lie group with Lie algebra g. Then one shows, see [20] and [5], 

that 

P:={ 9 6G:Ad( 5 )(g ! )Cg ! V*} 
G := {g e G : Ad(g)( dt ) C dl Vz} 

are closed subgroups of G with Lie algebras p = g° and g , respectively. 
In particular, restricting the action of Go to the nilpotent subalgebra 
g_ we obtain an action by Lie algebra automorphisms, i.e. a homomor- 
phism Go — > Aut 9r (g_). 

The homogeneous spaces of the form G/P are the so-called gen- 
eralized flag manifolds, which are of central interest in representation 
theory. It turns out that they are always compact. 

Proposition 2.3. The generalized flag manifold G/P carries a natural 
distribution H C T(G/P) of rank dim(g_i) ; whose bundle of symbol 
algebras is locally trivial with modelling algebra g . The natural left 
action of G on G/P preserves this distribution. 

Proof. The tangent bundle of G/P can be identified with the asso- 
ciated bundle G x P (g/p). Now the P-invariant filtration {$f} of g 
induces a P-invariant filtration g/p = g~ fc /p ^ ' " ' ^ _1 /P- F° r each 
% = —k, . . . , —1, we get a smooth subbundle G x P (g J /p) =: T l (G/P) C 
T(G/P), i.e. a filtration of the tangent bundle of G/P. Explicitly, de- 
noting by p : G — ► G/P the natural projection, the subbundle T l (G/ P) 
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is given by 

T gP (G/P) = T g p({L x (g):Xeg 1 }), 

where Lx denotes the left invariant vector field generated by X. This 
immediately shows that the left actions of elements of G preserve the 
filtration {T l (G/P)} of the tangent bundle. 

By construction, the component gr i (T(G/P)) of the associated graded 
is the bundle induced by the representation (Q l /p)/(Q l+1 /p) = Q 1 /q 1+1 - 
Consider sections £ £ T l (G/P) and rj £ T^(G/P) with i < j. By con- 
struction, there are local lifts £, fj £ X(G) which can be written in the 
form £ = ^2 a f a Lx a and fj = J2b ^b^Yb f° r smooth functions <p a and 
^6 and elements X a £ 0* and Y b £ g J . This shows that [£,77] can be 
written as the sum of 

Y, a ,bVa,M L X a ,L Yb ) = T,a,b¥a^bL [Xa ,Y b ] 

and a linear combination of left invariant vector fields with generators 
in g 2 . Hence we conclude that [£, rj\ £ T (T l+:j (G / P)) . Since g_ is gen- 
erated by g_i we conclude that the distribution H := T~ l {G/P) is 
bracket generating and that {T l (G/P)} is the associated filtration as 
described in 12.21 Finally, it also shows that under the natural identifica- 
tion 0*/g t+1 — Qi, the symbol algebra of H in each point is isomorphic 
tog_. □ 

2.4. Canonical Cartan connections. Since the algebras q are al- 
ways semisimple, there is a natural choice of a Lie group G with Lie al- 
gebra q, namely the automorphism group Aut(g). Then the subgroups 
Go C P C G are the groups Aut 9r (g) C Aut/(g) of automorphisms 
preserving the grading respectively the filtration of g. Now we have to 
assume an additional (cohomological) condition on the grading of g. 
The first Lie algebra cohomology group -f/^g^g) consists of equiva- 
lence classes of linear maps g_ — > g, and there is an obvious notion 
of homogeneity for such maps. The Lie algebra differentials are com- 
patible with homogeneity, so the cohomology group naturally splits 
according to homogeneity. 

Assuming that H 1 (q-,q) is concentrated in negative homogeneities, 
it turns out (see [15]) that the homomorphism Go — > Aut 9r (g_) is 
actually an isomorphism, and then the general prolongation procedures 
of [TBI EDI E] imply 

Theorem 2.4. Let M be a smooth manifold such that dim(M) = 
dim(G/P) endowed with a bracket generating distribution H C TM of 
rank dim(g_i), whose bundle of symbol algebras is locally trivial with 
modelling Lie algebra g_. Then the natural frame bundle for M with 
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structure group Aut 9r (g„) = G can be canonically extended to a prin- 
cipal P -bundle Q — ► M, which can be endowed with a regular normal 
Cartan connection uo G Q 1 (Q,g). 

The pair (G,u) is uniquely determined up to isomorphism, and the 
construction actually establishes an equivalence of categories between 
manifolds endowed with appropriate distributions and regular normal 
Cartan geometries. 

Let us explain this a bit. First of all, it is easy to see (compare with 
[201 [5]) that Go can be naturally viewed as a quotient of P. Indeed, 
the exponential map defines a diffeomorphism from g 1 onto a closed 
subgroup P + C P such that P/P+ — Go. The statement that Q extends 
the natural frame bundle then simply means that the quotient G/P+ is 
(via forms induced by the Cartan connection) isomorphic to this frame 
bundle. 

A Cartan connection on Q by definition is a one-form uj G fi 1 (^,g) 
such that u(u) : T U Q — * g is a linear isomorphism for each u G Q. 
Further, u has to be equivariant for the principal right action of P, 
i.e. {r 9 )*uj = Ad(g _1 ) o uj for all g G P, and it has to reproduce the 
generators of fundamental vector fields. The pair (Q, u) is then referred 
to as a Cartan geometry of type (G,P). Cartan geometries can be 
viewed as "curved analogs" of the homogeneous space G/P, which 
determines a Cartan geometry via the natural principal bundle G — > 
G/P and the left Maurer-Cartan form on G. In this context, G/P is 
referred to as the homogeneous model of geometries of type (G, P) . 

The amount to which a general Cartan geometry differs from the 
homogeneous model is measured by its curvature. This is the two-form 
KeQ 2 (g,Q) defined by 

From the defining properties of a Cartan connection it immediately 
follows that K is horizontal and P-equivariant. In particular, its value 
on £ and 7] depends only on the projections of the tangent vectors to M. 
The uniqueness of the Cartan connection in the theorem is ensured by 
the conditions of regularity and normality on the curvature. Regularity 
means that if the image of £ and rj in TM lie in the subbundles T l M 
and T j M, respectively, then K(£,r}) G Q l+j+1 . 

The condition of normality is crucial for the uniqueness question, 
and finding appropriate normalization conditions often is a very diffi- 
cult step in the construction of canonical Cartan connections. For the 
purposes of this article, we do not need any details on the form of this 
condition. The only information we need (and also this is only needed 
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to deal with the non-flat case) is that K determines a natural quantity 
called the harmonic curvature, which is a section Kh of the associated 
bundle Q x P (H 2 (g_, g)). Vanishing of the harmonic curvature is equiv- 
alent to vanishing of K and to local isomorphism of the geometry with 
G/P, see 0. 

The theorem on existence and uniqueness of Cartan connections has 
important consequences for the homogeneous model. 

Corollary 2.4. Suppose that iJ 1 (g_,g) is concentrated in negative ho- 
mogeneities. Then for any connected open subset U C G/P, the au- 
tomorphism group of the distribution T~ l U := T~ 1 (G/P)\u C TU is 
the subgroup of G consisting of all elements whose left action on G/P 
maps the subset U to itself. In particular, the automorphism group of 
T' 1 {G/P) itself is the group G = Aut(g). 

Proof. Of course, any element of G whose left action preserves U gives 
rise to an automorphism. Conversely, let p : G — > G/P be the natural 
projection and let u be the left Maurer Cartan form on G. Then u re- 
stricts to a Cartan connection on the principal P-bundle p _1 (f/) — ► U, 
which is flat by the Maurer-Cartan equation. Hence it must be the 
normal Cartan connection determined by T~ X U . The equivalence of 
categories stated in the theorem implies that any automorphism of U 
lifts to an automorphism of the Cartan geometry, i.e. to a P-equivariant 
diffeomorphism on p~ l (U) which is compatible with the Cartan con- 
nection. Then [161 Theorem 5.2] applied to the given automorphism 
and the identity shows that on each connected component of p~ l (U) 
the automorphism is given by the left action of some element of G. 
Since U is connected, P acts transitively on the set of connected com- 
ponents of p~ l (U), so P-equivariancy implies that we always get the 
same element g G G. □ 

2.5. Automorphism groups. For distributions which are equivalent 
to Cartan geometries, any automorphism of the distributions canon- 
ically lifts to the Cartan geometry, so the automorphism groups of 
the distribution can be identified with the one of the Cartan geom- 
etry. Of course, an automorphism of a Cartan geometry (Q, u>) is a 
P-equivariant diffeomorphism $ : Q — > Q such that Q*u = u. There is 
an obvious infinitesimal analog of this concept. Namely, the flow of a 
complete vector field on Q consists of automorphisms if and only if the 
field lies in 

inf(0,w) := {£ e X(G) : (r 9 )*£ = f for all g G P and C^u = 0}, 

where (r 9 ) is the principal right action of g and £ denotes the Lie de- 
rivative. This is called the set of infinitesimal automorphisms of the 
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geometry. Notice that by definition inf(Q,u) is closed under Lie brack- 
ets. 

Theorem 2.5. (1) Let (p : Q — > M,u) be a Cartan geometry of type 
(G, P) with connected base M. Then the automorphism group Aut(Q, o>) 
can be made into a Lie group of dimension < dim(G), whose Lie algebra 
aut(Q,u) consists of all complete vector fields contained in inf(Q,u). 

(2) For any point u G Q , the map £ h-> u>(£(u)) induces an injec- 
tion aui(Q,u) ^n> g. Denoting by a C g the image, the Lie bracket on 
aut(£, u>) is mapped to the operation 

(X,Y) ^ [X,Y]-K(u;-\X),u;-\Y))(u) 

on a. 

(3) If the Cartan geometry is regular, then restricting the filtration 
{q 1 } °f Q t° the subspace a makes aut(Q,uj) into a filtered Lie algebra. 
The associated graded of this Lie algebra is isomorphic to a graded Lie 
subalgebra of g. 

Proof. We first claim that £ *— > u(^(u)) defines an injection inf (Q, u>) — > 
g, i.e. that any infinitesimal automorphism is determined by its value 
in one point. Using the standard formula for the Lie derivative and 
inserting the definition of the exterior derivative, we get 

= {£^){r,) = du&rj) + rMO = Mv) ~ w([Z,v])- 

for £ G inf(G,u) and r\ G X(Q). In particular, if u(rj) is constant, then 
injectivity of u> implies [£, 77] = 0. But this implies that £ is invariant 
under the flows of such fields. Since such fields span each tangent space, 
we see that £(u) determines £ locally around u. Since £ is P-invariant, 
this determines the restriction of £ to p~ l (U) for some open neighbor- 
hood U of p(u) in M. Now connectedness of M implies that £ is globally 
determined by £,(u). In particular, inf(Q,uj) is a finite dimensional Lie 
subalgebra of 3t(Q), and (1) follows from R. Palais' characterization of 
Lie transformation groups, see [13] , 

(2) We already know that aut(£, uj) injects into g, so it remains to 
verify the formula for the Lie bracket. It is well known that the Lie 
bracket on aut(Q,u) is induced by the negative of the Lie bracket of 
vector fields. Now for £,77 G inf (Q,u>), we get 

= dw(£, r,) + 7/-w(0 = m, v ) - [u(£)Mv)] + u(h £]), 

where we have used the definition of K to rewrite the first term and 
the infinitesimal automorphism equation for 77 to rewrite the second 
one. This evidently implies that claimed formula. 

(3) The regularity of the geometry implies that for X G g 1 and Y G g^ 
we get K(u>~ 1 (X),u>~ 1 (Y))(u) G 0* +J ' +1 . This implies that the modified 
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bracket on a still respects the filtration and that the i^-term does not 
contribute to the bracket on the associated graded. Since the filtration 
of g comes from a grading, the associated graded of g is isomorphic to 
g itself, and the last statement follows. □ 

Part (3) of this theorem is the main input for getting restrictions 
on possible automorphism groups. To get additional information for 
geometries which are non-flat (i.e. not locally isomorphic to G/P) we 
need an additional bit of information. We have briefly discussed in 12.41 
the harmonic curvature Kh of uj which is a section of Q x P H 2 (g^, g). 
Hence it corresponds to a P-equivariant function Q — > H 2 (q_,q). Now 
it turns out that the latter representation is completely reducible, so 
the P-action factorizes through Gq. Naturality of the construction of Kh 
implies that any infinitesimal automorphism of (Q, u) has to preserve 
Kh, i.e. annihilate the corresponding function. Using this, we formulate 

Corollary 2.5. Let g = ©f = _ fc gj be a \k\-graded Lie algebra such 
that H 1 (q^,q) is concentrated in negative homogeneous degrees, and 
let Gq C P C G be the corresponding groups. Let M be a smooth man- 
ifold of dimension dim(G/P) endowed with a distribution H C TM of 
rank dim(g_i) such that the bundle of symbol algebras is locally trivial 
and modelled on g_ . Let Aut(M, H) be the group of all diffeomorphisms 
of M which preserve the distribution H . 

(1) Aut(M, H) is a Lie group of dimension < dim(G). 

(2) If C, := dim(Aut(M, H)) < dim(G), then P. equals the dimension of 
a proper graded subalgebra b = ©*L_ fc bj of g. 

(3) If (M, H) is not locally isomorphic to the canonical distribution 
on G/P induced by g _1 /p C g/p ; then the graded Lie subalgebra in (2) 
has the additional property that there is a nonzero element in PT 2 (g_, g) 
which is annihilated by all elements of bo- 



Proof. In view of the equivalence of categories proved in theorem 
parts (1) and (2) follow directly from parts (1) and (3) of theorem 12.51 
For part (3), we can choose our point u G Q in such a way that 
Kh(u) 7^ 0. Then the value in u of the corresponding equivariant func- 
tion determines an element of H 2 (q_,q). Elements of a correspond to 
infinitesimal automorphisms £ such that u> (£)(«) G g° = p, i.e. such 
that £(w) is vertical. Differentiating an equivariant function along £, 
the result in u therefore coincides with the algebraic action of u> (£)(«) 
on the value of the function. By complete reducibility of H 2 (q_,q), this 
action depends only on the component in g = Q°/d 1 - D 

Remark 2.5. (1) By definition any infinitesimal automorphism £ of 
a Cartan geometry of type (G, P) is a right invariant vector field and 



AUTOMORPHISM GROUP OF DISTRIBUTIONS 11 

hence projects to an vector field £ on M. For geometries equivalent to 
distributions, this is the "actual" infinitesimal automorphism, i.e. its 
local flows preserves the distribution. The filtration from part (3) of 
the theorem has a nice interpretation in terms of £. Namely, for u G Q 
and x = p(u) G M, we have u(£)(u) G Q l if and only if £(w) G T % X M for 
all i < 0. Likewise u> (£)(«) G g° if and only if £(«) = 0, so we have a 
fix point for the one-parameter group of automorphisms generated by 
£. The fact that u(£)(u) G g* for some i > can be interpreted (in a 
certain sense) as higher order vanishing of £ in x. 
(2) Part (3) of Corollary 12.51 shows that the dimension of bo is bounded 
by the largest possible dimension of an annihilator of a nonzero ele- 
ment in if 2 (g„,g), which can be easily determined using representa- 
tion theory as follows. The Lie algebra go is always reductive, and in 
the cases studied in this paper its center is one-dimensional and acts 
non-trivially on H 2 (q_,q). 

For a complex semisimple Lie group H and a complex irreducible 
representation V, one can consider the action of H on the projectiviza- 
tion P(V). It is well known (see chapter 23]) that the orbit of the 
line through a highest weight vector is the unique iJ-orbit of smallest 
dimension, and the stabilizer of this line is a parabolic subgroup of H, 
whose type can be read off the highest weight of V. Consequently, the 
stabilizer in if of a highest weight vector in V has the largest possible 
dimension among all stabilizers of non-zero vectors. Since the parabolic 
subgroup acts non-trivially on the highest weight line, this stabilizer 
has codimension one in the parabolic subgroup. 

If H is reductive with one-dimensional center which acts non-trivially 
(and by Schur's lemma by a scalar) on V, then one can look at the cor- 
responding parabolic subgroup in the semisimple part of H. Since both 
this parabolic subgroup and the center act non-trivially on the highest 
weight line, it follows that the stabilizer of a highest weight vector in 
H has the same dimension as the parabolic subgroup in the semisimple 
part. 

To apply this to our situation, we only have to notice that via com- 
plexification, the complex dimension of the stabilizer of a non-zero 
element gives an upper bound for the real dimension of the stabilizer 
of a non-zero element. Hence to obtain the upper bounds for dim(bo) 
one only has to compute the dimensions of parabolic subalgebras in the 
complexification of the semisimple part of go, whose type can be read 
off the highest weight of iJ 2 (g_,g), which is the output of Kostant's 
theorem. 
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3. Examples 

3.1. Generic rank n distributions in dimension — ^ — -. For n > 3 

consider IR 2n+1 with the (indefinite) inner product 

n n 

( Vj W ) = V n+1 W n+1 + ^ ViW n+1+i + ^ Vn+l+iWi- 
i=l i=l 

By definition, the subspaces generated by the first n respectively by 
the last n vectors in the standard basis are isotropic, which shows that 
the inner product has split signature (n + l,n). The orthogonal Lie 
algebra g = so(n + 1, n) for this inner product has the form 



A v B 

w —v l 
C -w l -A 1 



Ae Ql(n,R),C,B e o(n) 

v eR n ,w er 



This admits an obvious grading of the form 

0o 0i 02 N 

0-1 00 01 
v 0-2 0-1 0o / 

with blocks of sizes n, 1, and n. The associated parabolic subalgebra p = 
0° is the stabilizer of the n-dimensional isotropic subspace generated 
by the first n basis vectors. From this representation it is evident that 
0o — gl(n,M.). The adjoint action makes each Qi into a 0o~ m odule and 
the bracket on g induces homomorphisms of 0o~ m odules. From the 
matrix representation it is evident, that Qi = R™, $j_i = lR n * as Qq- 
modules. Further, the bracket induces isomorphisms A 2 0-ti — > g±2 and 
0-i <8> 0i — > 0o- Finally, the restrictions q±i x g T2 — > Q T \ of the bracket 
are induced by (w, B) \— > wB and (v, C) \-^ Cv, respectively. 

The general tools mentioned in 12.11 show that if 1 (g_,g) is concen- 
trated in negative homogeneities in this case, see also [15]. Putting 
G = Aut($j) and P = Aut/(g) we can thus apply the results from 12.41 
The corresponding bracket generating distributions are rank n distri- 
butions on manifolds of dimension n(n + l)/2. If H C TM is such a 
distribution, then the condition that the bundle of symbol algebras is 
locally trivial and modelled on g_ simply means that for each x G M, 
the Levi bracket induces an isomorphism A 2 H X — > T X M/H X . Since we 
know that one such distribution exists (on G/P, which can be viewed as 
the Grassmannian of all isotropic n-dimensional subspaces in R 2n+1 ), 
this is evidently a generic condition. This clearly is the only generic 
type of rank n distributions in dimension " (w+ '- . For the minimal value 
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n = 3, we obtain generic rank 3 distributions in dimension 6. These 
have been studied by R. Bryant in his thesis, see pfl [2] . 

Theorem 3.1. Let M be a smooth manifold of dimension n(n+ l)/2, 
H C TM a generic distribution of rank n, and let Aut(M,H) be the 
group of all diffeomorphisms of M which are compatible with H . 

(1) Aut(M, H) is a Lie group of dimension at most 2n 2 + n. 

(2) J/dim(Aut(M,if)) < 2n 2 + n, then dim ( Ant (M, H)) < 2n 2 -n + l, 
i.e. the dimension has to drop by at least 2n — 1. 

(3) If (M, H) is not locally isomorphic to the canonical distribution on 
G/P, then 

{13 n = 3 

2„*-3 7 „ + 6 5<^<8 
2n 2 - 3n + 5 n > 9 

Proof. (1) follows immediately from part (1) of Corollary 12.51 In view 
of part (2) of that Corollary, we can prove (2) by showing that any 
proper graded subalgebra b = © 2 = _ 2 bj of g has dimension at most 
2n 2 — n + 1. Suppose that b is such a subalgebra and put dj = dim(bj) 
for all j = -2, . . . , 2. 

Let us first assume that d_i = n, i.e. b_i = g_i. Then g_ 2 = 
[fl-i)0-i] C b, so all of 0_ is contained in b. Then we must have 
bi 7^ 0i) since otherwise also jj 2 = [0i,0i] and jj — [0-i;0i] would 
be contained in $j. 

Hence C := d\ < n. The group Go = Aut 9r (g_) is isomorphic to 
GL(g_i) and conjugating b by an appropriate element of this group, 
we may assume that b\ = M £ C lR n = gi. Now [b_i, 62] C bi and since 
b_i = g_i the description of the bracket shows that the matrices in b 2 
may have nonzero entries only in the first £ rows, so <i 2 < £(£ — l)/2 by 
skew symmetry. In particular, iid\ = then d 2 = and we have already 
lost n(n+ 1)/2 > 2n dimensions. So we may assume that 1 < £ < n — 1. 
Then bo C go = gl(n, R) must stabilize bi, so do < n 2 — (n — £)£, and 
this becomes maximal for £ = 1 and £ = n — 1, whence do < n 2 — n + 1. 
From above, we know that <i 2 < 2 = n ~^" +2 ; so we conclude 

that 

dim(b) < n(n_1) + n + (n 2 - (n - £)£) + z + ^~ X) < 2n 2 - n + 1, 

with equality attained for £ = n — 1. 

If g?! = n, the situation is completely symmetric and we get the 
same bound on dim(b), so it remains to consider the case that both 
d\ and d-\ are smaller than n. We claim, that in these cases already 
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d-x + do + di < dim(0_i) + dim(g ) + dim(g 1 ) — 2n+l. This is evidently 
true if gL_i = d 1 = 0, so by symmetry we may assume that for d\ — £ 
we have < £ < n. Then we know that d$ < n 2 — (n — £)£, so we have 
lost at least n — 1 dimensions already. If d_i < n — £ then we have also 
lost at least n dimensions from d±\ and we are done again. 

Hence we are left with the case that £' := d-\ > n — £. Since g_i 
and Qi are dual g -modules, the annihilator of b_i in g x is a subspace 
of dimension n — £' < £ which by construction must be invariant under 
bo- Hence bo has to preserve two subspaces of different dimensions. 
Preserving the ^-dimensional subspace forces do < dim(g ) — (n — 1). 
If the second subspace is contained in the first one, we loose £ — 1 more 
dimensions, so the total loss adds up to (n — 1) + £ — 1 + n — £ + n — 
£' = 3n — 2 — £', and since £' < n, this is at least 2n — 1. If the two 
subspaces are not nested but have non-trivial intersection, then the 
same argument applies to one of them and the intersection. Finally, if 
the two subspaces are transverse, then each of them causes a reduction 
of (n — 1) dimensions for bo- 

(3) Denote by b = © 2 = _ 2 bj the graded subalgebra of g associated to the 
Lie algebra of the automorphism group, cf. Corollary 12.51 From part 
(3) of this Corollary we know that bo annihilates a nonzero element in 

# 2 (0-,0). 

If n — 3 the go-module if 2 (g_,g) is the irreducible component of 
highest weight in R 3 <g> R 3 <g> A 2 R 3 <g> (R 3 )*. Following Remark [53] (2), 
dim(bo) is bounded by the dimension of the Borel subalgebra of the 
complexification of go, so dim(bo) < 5. 

Suppose first that gLi = 3. Since g = 0-i<8>fli and do < 5, we obtain 
di < 1. Hence d 2 = and dim(b) < 12. The same argument applies 
to di = 3. If gLi < 2, then g = g_i <2> gi and d < 5 imply d x < 2. 
If rf_! = 2, we may assume that b_i = R 2 C R 3 . Since di < 2 and 
g 2 x b_i — > gi is surjective, we must have d 2 < 2. For d\ < 1 we are 
done, since we already lost 8 dimensions. If d\ = 2 we conclude from 
[b_2j bi] C b_i that d_ 2 < 2 and therefore dim(b) < 13 also in this 
case. For gLi < 1 and d\ < 1 one already has dim(b) < 13. If <i_i < 1 
and d\ > 1 we can use the arguments above to see dim(b) < 13, thus 
completing the proof for n = 3. 

For n > 3 the go-module H 2 (q_,q) is the irreducible component 
of highest weight in R n <g> A 2 R n ® A 2 (R n )*. Following Remark [53J 
(2), we can compute the dimension of parabolic subalgebra in the 
complexification of g to conclude that dim(b ) < n 2 — 4n + 10. If 
rf_i = n, then we have di < - ~ 4w+10 ; since go — g-i ® 0i- Fur- 
ther we know that d 2 < 2 ■ Putting this together we conclude 
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dim(b) < 2n 2 — In + 26 — — + -^. The same argument applies if 
d\ — n, so it remains to consider the case d-\, d± < n — 1. 

If < d-i < n — 1 and 2 < d\ < n — 1, then the surjectivity of 
g_ 2 x bi — > 0_i forces gL 2 < dim(0_ 2 ). A straightforward analysis 
of the possible cases using g^-gLi < n 2 — An + 10 shows that we get 
dim(b) < 2n 2 — 3n + 5 + — ^-j-. By the symmetry of the grading one 
obtains the same bound for d_i > 2. Finally, if g?_i, c?i < 1, we already 
have dim(b) < 2n 2 — hn + 12. 

Comparing the three bounds obtained so far, we see that dim(b) < 
2n 2 — 3n + 5 + — ^- is always valid for n > 5 while dim(b) < 27 for 
n = 4. □ 

Remark 3.1. (1) From the proof we see that for each k — 1, . . . , n — 1 

b fc := A 2 (M n )* © (M n )* © ( J : ) © M fe © A 2 M fc 

is a graded subalgebra of q. The algebra b" _1 is a graded subalgebra of 
the maximal possible dimension 2n 2 — n + 1. It turns out that, up to 
conjugation, it is the unique graded subalgebra of this dimension. For 
each k, one can actually realize b k as the Lie algebra of the automor- 
phism group of a generic distribution. Namely, consider the canonical 
distribution on the homogeneous model G/P. Then G/P is the space 
of all maximal isotropic subspaces of IR n+1,r \ For each k = 1, . . . , n let 
Wk be the isotropic subspace spanned by the last (n — k) vectors in the 
standard basis of IR n+1,n . Then the maximal isotropic subspaces which 
intersect Wk only in form an open subset Uk of G/P. Restricting the 
canonical distribution to this subspace, Corollary 12.41 shows that the 
automorphism group of this restriction is the subgroup of G consisting 
of all elements whose action on G/P preserves Uk- It is elementary to 
show that this coincides with the stabilizer of Wk in G, and hence has 
Lie algebra isomorphic to b k . 

(2) The fact that Go — GL(q-i) implies that sub-Riemannian met- 
rics on generic distributions of the type we consider have no pointwise 
invariants. Hence for any sub-Riemannian structure on such a distri- 
bution [12] constructs a canonical Cartan connection. 

3.2. Generic rank two distributions in dimension five. This is 
the classical example studied in Cartan's article [6] from 1910. The 
simple Lie algebra in question is the split real form of the exceptional 
Lie algebra of type G 2 . Although it is not difficult to describe an ex- 
plicit matrix representation for this Lie algebra, all the information 
we need can be directly obtained from the root system of type G 2 . 
There are two simple roots, ot\ and a 2 , and the other positive roots are 
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«i + ol-ii 2o!i + «2, 3ai + a 2 , and 3ai + 2a 2 . The grading we are inter- 
ested in comes from the coefficient of the short simple root a,\. Hence 
this is a 1 3 [-grading, and the dimensions of the grading components 
are dim(g± 3 ) = dim(g±i) = 2, dim(g±2) = 1, and dim(g ) = 4. This 
decomposition works for the complex simple Lie algebra of type Gi 
as well as for its split real form. The root decomposition also implies 
immediately that the Lie bracket induces isomorphisms g — g[(g_i), 
A 2 g±i = q±2, and g±i £3>g±2 — > g±3- Note that together with the dimen- 
sions of the components, the last two statements completely determine 
the structure of the subalgebra g_. Finally, for i = 1,2,3 the compo- 
nents Qi and g_j are dual g -modules. Using this, we can identify 0-1-3 
with g ± 2 ® g±i an d g^i with q* ±1i and under these identifications, the 
bracket g± 3 ® g^i — > g± 2 is induced by the dual pairing g ±1 ® g^ 1 — > BL 
Now suppose that M is a smooth manifold of dimension five and 
H C TM is a distribution of rank 2. Since A 2 H then has rank one, 
we see that for x G M the subspace spanned by sections of H and 
brackets of two such sections can have dimension at most three, and 
forming the bracket with another section of H, one can get at most two 
additional dimensions. The distribution H is called generic if and only 
if brackets of sections of H of length at most three span all of the tan- 
gent space, i.e. if and only if H has small growth vector (2, 3, 5). This 
is evidently equivalent to the fact that the Levi bracket induces iso- 
morphisms A 2 H X -> T~ 2 M/H X and (T~ 2 M/H X ) <g> H x -> T X M/T~ 2 M, 
i.e. that each symbol algebra is isomorphic to g_. Putting G := Aut(g) 
and P := Auty(g), Theorem 12.41 implies that regular normal parabolic 
geometries of type (G, P) are equivalent to generic rank two distribu- 
tions on five-manifolds. 

Theorem 3.2. Let M be a smooth manifold of dimension five, H C 
TM a generic distribution of rank two, and Aut(M,H) the automor- 
phism group of this distribution. 

(1) Aut(M, H) is a Lie group of dimension at most 14. 

(2) Ifdim{Aut{M,H)) < 14, then dim(Aut(M, H)) < 9. 

(3) If (M, H) is not locally isomorphic to the canonical distribution on 
G/P, then dim(Aut(M, H)) < 8. 

Proof. For (2) it remains to show that any proper graded subalgebra 
of g has dimension at most nine. Suppose that b = ©f = _ 3 bj is such a 
subalgebra and put dj := dim(bj) for j = — 3, ..., 3. Let us first assume 
that g_! C b, i.e. that d_i = 2. Since g_ is generated by g_i, this 
implies that g_ C b. Hence gi cannot be contained in b, so di < 2. 

Now the bracket induces an isomorphism g 2 ® g_i — > 0i, so we must 
have g?2 = 0. But then also d% = 0, since bracketing with a nonzero 
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element of q 3 is a surjection g_x — > g 2 . If <^i = 0, then we conclude 
dim(b) < 9. If d\ = 1, then the fact the the adjoint action of bo on 
gi must preserve the one dimensional subspace b\ C $ji implies that 
do < 3, and hence we again get dim(b) < 9, so the case d-\ = 2 is 
complete. By symmetry this also applies if d\ — 2, so we are left with 
the case that d_i, d\ < 1. 

If oLi = 0, then either d 2 — or gL 3 = 0, and likewise d\ = implies 
that gL 2 = or d 3 = 0. In particular, oLi = di = implies dim(b) < 8. 
If gLi = and d\ = 1, then do < 3 implies that dim(b) < 9. By 
symmetry, this also holds if di = and d_i = 1. Finally, if cZ__i = di = 1, 
then do < 3, either d_ 3 = 1 or d 2 = 0, and either d 3 = 1 or gL 2 = 0, so 
again dim(b) < 9. 

(3) Let b = © 3 = _ 3 bj be the graded subalgebra of $j associated to 
the Lie algebra of the automorphism group. By part (3) of Corol- 
lary [231 bo stabilizes a nonzero element in the irreducible Qo~ module 
# 2 (fl-,0) - S 4 (0i)- Following Remark [23] (2), we get dim(b ) < 2 and 
the arguments from the proof of (2) show that dim(b) < 8. □ 

The simplest example of a proper graded subalgebra of the maximal 
possible dimension 9 is given by fl- ©0o- This can be realized as the Lie 
algebra of the automorphism group of the complement of a point in the 
homogeneous model G/P. Similarly, $j„ © bo © bi for a line b\ C 0i and 
its stabilizer bo in Qo can be easily realized. The homogeneous model 
G/P can be viewed as the space of null lines in the seven dimensions 
space of purely imaginary split octonions and b can be realized as the 
Lie algebra of the automorphism group of the complement of a fixed 
null line. It is easy to give a complete description of all the graded 
subalgebras of g of dimension 9, and all of them can be realized, see 

im 



3.3. Generic rank four distributions in dimension seven. The 

last example we consider is rank four distributions with small growth 
vector (4, 7) on manifolds of dimension seven. For such a manifold, the 
Levi bracket in a point x is a map A 2 H X —>■ T X M/H X . Choosing an 
isomorphism H x — > M 4 and T X M/H X —>■ R 3 , we have to deal with the 
space L(A 2 ]R 4 ,1R 3 ) of linear maps, which has dimension 18. Changing 
the identifications of H x with M 4 and of T X M/H X with IR 3 is expressed 
by the natural action of the group GL(4,M) x GL(3,M), which has 
dimension 25. Thus the Levi bracket in x corresponds to a well defined 
orbit of the natural action of GL(4,R) x GL(3,R) on L(A 2 M 4 ,M 3 ). 

In this picture, a distribution is stable (up to isomorphism) under 
small perturbations if and only if the corresponding orbit is open in 
L(A 2 R 4 ,M 3 ). It turns out (see jSl 7.12]) that there are exactly two 
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open orbits, and hence two types of generic distributions. From the 
dimension count, we see that this is equivalent to the fact that the 
stabilizer in GL(4, R) x GL(3, R) of the corresponding map has dimen- 
sion seven. We can also view an element of L(A 2 R 4 , R 3 ) as defining the 
structure of a graded Lie algebra of R 4 © R 3 , and then the stabilizer in 
GL(A, R) x GL(3, R) is exactly the automorphism group of this graded 
Lie algebra. Hence generic distributions are in bijective correspondence 
with graded Lie algebras structures on R 4 © R 3 whose automorphism 
group has dimension seven (which is the minimal possible dimension). 
To relate this to parabolic geometries, consider the complex simple 
Lie algebra g c := sp(6,C) of endomorphisms of C 6 which preserve a 
non-degenerate skew symmetric bilinear form. For this form, we use 
(z,w) I— > J2j=i(~^y z j w 6-j- F° r a matrix A 6 gl(2,C) we denote by 
A e gl(2,C) the classical adjoint, so AA = AA = det(A)I. Using this, 
we can realize g c as 

A 13 ,A 22 ,A 31 6*1(2, C) 
A 11 ,A 12 ,A 21 eqI(2,C) 

In this realization, we have an evident |2|-grading, with q^ correspond- 
ing to the entries A u and A 22) g^ 2 to A 31 , g^ to A 21 , g^ to A 12 , and 
q 2 to A13. Hence the complex dimensions of the ±l-components are 
four, the ±2-components have complex dimension three, while the 0- 
component has complex dimension seven. The Lie bracket of g^ thus 
defines a map A 2 C 4 — > C 3 . Now the cohomological condition from 12.41 
is satisfied for any real form of the given grading on g c . From 12.41 we 
know that if g = © 2 = _ 2 0i is suc h a re& l form and G = Aut(g), then the 
subgroup G C G with Lie algebra g is isomorphic to the automor- 
phism group of the graded Lie algebra g_. Since dim(g ) = 7, any such 
real form corresponds to a generic rank four distribution in dimension 
seven, and by Theorem 12.41 such distributions then are equivalent to 
regular normal parabolic geometries of type (G, P). 

It turns out that there are two real forms of this grading. One is 
the split real form sp(6, R). With respect to the obvious real analog of 
the bilinear form used above, we get the same matrix representation as 
for g c above but with the blocks lying in gl(2, R) respectively sl(2, R). 
The other real form is obtained by passing to quaternionic matrices. If 
we identity C 6 with H 3 , then our skew symmetric form comes from a 
quaternionic Hermitian form of signature (2, 1). Maps preserving both 
the quaternionic structure and the skew form also preserve the quater- 
nionic Hermitian form, and hence form a Lie algebra isomorphism to 
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sp(2, 1). The matrix representation in this case is exactly as above 
but with the quaternions H replacing g[(2,R), the purely imaginary 
quaternions im(EI) replacing si(2, R), and the quaternionic conjugation 
instead of the classical adjoint. 

The deeper reason for this dichotomy is that up to isomorphism there 
are exactly two real composition algebras of dimension four, namely 
the quaternions with their standard positive definite quadratic form, 
and the split-quaternions, which are isomorphic to the algebra of 2 x 
2-matrices, with the quadratic form given by the determinant. This 
quadratic form is preserved by the action of Go up to scale. Passing 
to distributions this means that any generic rank four distribution in 
dimension seven admits a canonical conformal class of inner products 
(i.e. a canonical conformal sub-Riemannian structure) which is either 
definite or of split signature. We refer to these cases as elliptic type 
respectively hyperbolic type. 

3.4. Results for elliptic type. Here we have g = sp(2, 1), g±i = EI, 
and Q±2 — im(H). The bracket A 2 g ±1 — ■> g ±2 is given by (p, q) i— ► pq — qp 
for p, q G HI. The brackets g± 2 x g Tl — > g ±1 is given by (p, q) \— > pq. 
Finally, the adjoint action on g_i = EI identifies Go with the conformal 
group CSO{A). 

Theorem 3.4. Let M be a smooth manifold of dimension seven, let 
H C TM be a generic rank four distribution of elliptic type, and let 
Aut(M, H ) be the automorphism group of H. 

(1) Aut(M, H) is a Lie group of dimension at most 21. 

(2) f/ dim(Aut(M, if)) < 21, then dim(Aut(M, H )) < 14. 

(3) If (M, H) is not locally isomorphic to the canonical distribution on 
G/P, then dim(Aut(M, H )) < 12. 

Proof. As before, we only have to prove (2) and (3), and for (2) we 
have to show that any proper graded subalgebra b C g has dimension 
at most 14. We put b = ©| = _ 2 bj and dj := dim(b J ). 

Let us first assume that b_i = g_i, i.e. that d-\ = 4. Then b_ 2 = 9-2, 
and to obtain a proper subalgebra, we have to have d\ < 4. Since the 
bracket with a non-zero element of g 2 defines a surjection g_i — ► gi, 
we see that we must have di = 0, which in turn implies that di < 1. If 
d\ = 0, then we have dim(b) < 14. If d\ = 1, then bo has to stabilize a 
line in g l5 which forces d < 4, so we get dim(b) < 12. If d\ = 4, then 
the result follows in the same way by symmetry. 

Let us next assume that d-\ = 3. Conjugating by an element of Go, 
we may assume that b_i is spanned by l,i,j G EL This shows that 
b_ 2 = g_ 2 , and then the fact that [bi,g_ 2 ] C b_i forces d\ < 1. This 
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is only possible if d 2 = 0, and dim(b) < 14 readily follows. The same 
argument applies if d\ = 3. 

If cZ_i = 2, then we may assume that b_i is spanned by 1 and i, and 
then conclude that d- 2 > 1. If d_ 2 = 1, then we must have di < 2, 
and this is only possible if d 2 < 1, so we have lost eight dimensions 
already. If cZ_i > 1, then d\ < 1 and g?2 = 0, and again we have lost 
eight dimensions. The case d\ = 2 can be treated in the same way. 

If oLi = di = 1, then both d 2 and d_ 2 must be < 1, so we have lost 
10 dimensions. If d_i = 1 and d± = 0, then we also must have d 2 = 0, 
and again we are done. Of course, 0L1 = d\ = already implies a loss 
of eight dimensions. 

(3) In the proof of (2) we have used restrictions on d only in one 
point, and there we obtained dim(b) < 12. Hence it suffices to prove 
that in the setting of (3) we have to have d < 5, since this causes a 
loss of two more dimensions compared to (2). But this follows imme- 
diately from Remark 12.51 (2) since the two irreducible components in 
H 2 (q^,q) are non-trivial, and the maximal parabolic subalgebras in 
the complexification of jjo have dimension 5. □ 

The simplest example of a proper graded subalgebra of g of the 
maximal possible dimension 14 is of course the parabolic subalgebra p. 
Since the group P is the stabilizer of the base point o in the homoge- 
neous model G/P, it is the subgroup of all elements that preserve the 
open subset G/P \ {o}. From Corollary 12.41 we conclude that P is the 
automorphism group of the canonical distribution on this open subset. 



3.5. Results for hyperbolic type. The description of the brackets 
is as in the elliptic case but replacing the quaternions EI by the alge- 
bra M 2 (M.) of real 2 x 2-matrices, the imaginary part by the subspace 
sl(2, M) of tracefree matrices, and the conjugation of quaternions by 
A = CA, the classical adjoint of A. The adjoint action of g±i = R 4 
identifies Go with the conformal group CSO(2,2) of split signature 
(2, 2), and the adjoint action on g± 2 = IR 3 maps Go onto CSO(l, 2). 

Theorem 3.5. Let M be a smooth manifold of dimension seven, let 
H C TM be a generic rank four distribution of hyperbolic type, and let 
Aut(M,H) be the automorphism group of H . 

(1) Aut(M, H) is a Lie group of dimension at most 21. 

(2) Ifdim(Aut(M,H)) < 21, then dim(Aut(M,#)) < 16. 

(3) If (M, H) is not locally isomorphic to the canonical distribution on 
G/P, then dim(Aut(M, H )) < 15. 
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Proof. To prove (2) we have to show that any proper graded subalgebra 
b C has dimension at most 15. We put b = ©| = _ 2 b,,- and dj := 
dim(bj). 

If d_i = 4, then 0_ C b and we must have d\ < 4. We have seen 
that the bracket 02 x 0-i ~~ > 0i is given by (A, B) i— » AC(B). Hence in 
contrast to the elliptic case, the map g_i — > gi defined by the bracket 
with a fixed element of 02 is only surjective for invertible elements. Since 
any subspace of sl(2, M.) of dimension at least two contains an invertible 
matrix, we obtain d 2 < 1. Moreover, we know that the bracket 0i x 
0i —> 02 is given by (A,B) i— > AC(B) — BC(A), the imaginary part 
of AC(B). Therefore we obtain d\ < 2, since otherwise we would have 
dim([bi, bi])) > 1. Now since bo has to stabilize the subspace b\ C 0i, 
we conclude that do < 6 and hence dim(b) < 16. The case d\ — 4 can 
be treated in the same way, so it remains to consider the case that 
d±i < 3. 

If d-x = 3, then b_i C 0_i is three dimensional, and we have to 
distinguish cases according to the signature (up to sign) of the restric- 
tion of the inner product to this subspace. The possible signatures 
are (2, 1), (2,0), and (1, 1). Since G = (75*0(2,2), any two subspaces 
with the same signature are conjugate. Using this, one verifies that in 
the first two cases, [b_i, b_i] = 0-2? so d^ 2 = 3. Then the fact that 
[0_2, bi] C b_i implies that d± < 2, and then [b 2 , b-i] C bi shows that 
d 2 < 1. This already shows that dim(b) < 16. 

For the remaining signature (1, 1), we may assume that b_i consists 
of all matrices of the form {(_? a c)}- Computing the bracket of two 
matrices of this form, we see that b_2 has to contain all matrices of 
the form {(q _ Q )} an d cL 2 > 2. If gL 2 = 3, then the results follows 
as above. Otherwise, the arguments on brackets as above show that 
d\ < 3 and d 2 < 2 and since b has to preserve non-trivial subspaces, 
we get do < 6 and hence dim(b) < 16. This complete the case d-\ — 3 
and hence also the case d\ = 3, so we are left with the case gLi, d\ < 2. 
Suppose < gLi < 2. Since bo has to stabilize b_i, we obtain at least 
do < 6. Hence in any case dim(b) < 16. If d-\ = we are already done, 
since d\ < 2 by assumption. 

(3) As in the proof of part (3) of Theorem 13.41 we obtain d < 5, and 
going through the proof of part (2), we see that in each case we loose 
at least one more dimension. □ 

Remark 3.5. The algebras from 13.41 and here as well as their grad- 
ings have the same complexification, so we are just dealing with two 
different real forms of one complex object. Remarkably, we obtain dif- 
ferent bounds on the sizes of possible automorphism groups in the 
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elliptic and hyperbolic case. The maximal possible dimension 16 of an 
automorphism group in the hyperbolic can actually be realized, so the 
two case are truly different. A realization is obtained as follows. In the 
notation from 13.31 let b C sp(6, R) be the subspace formed by all ma- 
trices for which A u = {(V*)}, A 12 = {(58)}, and A 13 = {(° * )}. One 
immediately verifies that this is a subalgebra of dimension 16. Let B 
be the corresponding subgroup of Sp(6,M), and consider the 5-orbit 
of o = eP in Sp(6,M)/P. Since b contains $j_, this orbit is open. The 
homogeneous space Sp(6, WL)/P admits a second interpretation, namely 
the space of all isotropic two planes in the symplectic vector space M 6 . 
In this picture, B is the stabilizer of a hyperplane in IR 6 , which shows 
that B cannot act transitively on Sp(6, M.)/P. Hence the 5-orbit of eP 
in this space is a proper open subset, so its automorphism group must 
be of dimension strictly less then the dimension of Sp(6,M). Since on 
the other hand, B is contained in this automorphism group, Theorem 
13.51 implies that we must have an automorphism group of dimension 
16. 
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